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TEE ALASKA SIMSflDB SIDDENT 1ESTIN5 PROGRAM: 
ARB HBB TBSfSS BIASED? 



Introduction 

Hie Alaska Statewide Student Assessment shows notable performance differences 
between students in urban and rural areas. Native and non-Native students, and 
bilingual and non-bilingual students. Some Alaska educators and parents react 
to the results of the Alaska Statewide Student assessment with concern and 
question the fairness of the Iowa itests of Baalc skills . 

Hhe Alaska Educational Research Association (AKERA) has prepared this paper to 
clarify what can be expected of norm referenced tests and to examine the extent 
to which the results of the Alaska Statewide Student Assessment may be affected 
by test bias. Sections of this p.^r have been prepared by Judith Rleinfeld of 
the University of Alaska, who serves as President of the AKERA, Nick Stayrook 
of the Fairbanks North Star Borough School District, Bob Silverman of the 
Alaska state Department of Education, Mary Francis who is Superintendent of the 
Petersburg City School District, and Fred Stofflet and ^ Fenton from the 
Anchorage School District. Ibis white paper has been reviewed, revised, and 
endorsed by the AKERA Board of Directors. 

What is ttie Alaska Statewide Student Assessment? 

The Alaska State Legislature makes a substantial contribution tu funding public 
education in Alaska. Through the public school foundation program, about $488 
million dollars wore spent in Alaska's 54 school districts during the 1939-90 
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school year* This represented an expenditure of proximately $4,600 state 
dollars per student* in absolute dollars per student, Alaska leads the nation 
in its si^rt o£ public education. 

Ihe Legislature in 1988 requested the state to iselect and ekSminister a single 
basic skills achieveinait test to determine the beief its of this ccmnitment to 
education* In re[^>onse to this legislative reg;uesty the Alaska State Board of 
B3ucation adopted regulations requiring that all students in grades 4, 6 and 8 
be tested each year with a uniformly administered test of reeding, mathematics 
and language arts. The intent of this regidation was to focus the attention of 
parents, conmunities, policy makers, and educators on the academic performance 
of students L, Alaska's school districts by making the results of the tests 
widely available. 

When cocrpared with other state programs to measure student performance, 
Alaska's testing program is modest in terms of the number of areas tested and 
amount of time devoted to testing. Ihe lowa Ttests of Basic s<i,lis (TIBS) was 
chosen by committees of educators from throughout the state as the best 
available norm referenced measure for Alaska. Ihc ITBS is a series of multiple 
choice tests measuring achievement in reading, mathematics and language arts. 
Die test takes a total of about 5 hours for students to cooplete, and most 
schools spread testing over several days. 
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Is the TIBS "biased" against Alaska Natives or other groups? 

Many people argue that a standardized test, such as the ITBS, is "biased" 
against Alaska Natives and other culturally different groups and therefore is 
an "unfair" measure of achievement. When people make this argument, they 
usually have in mind this problem: Sane test items ask questions about topics 
which are within thc^ comoon experience of urban mainstream children but outside 
the cornnon experience of rural Native children. As an &Ldanple, an item on the 
test may require children to knew what a "curb" is when mai^ rural Native 
children live in connunities without curbs. Hie test may require children to 
answer reading conprehenslon questions about a girl who dials "911" in an 
emergency, Manv rural Native children may find this reading section difficult 
and confusing because they do not live in connunities where people dial "911" 
in an emergency. 

Die ITBS indeed measures both the general knowledge and the academic skills 
useful in urban areas and in maljistream social settings.. These are skills 
important to balancing a checkbook, doing well in college, workitig effectively 
in a business or agency, or reading a newspaper with understanding. To do well 
in these situations indeed requires general knowledge, for exan?>le, knowing 
what a "curb" is and that "9il" is usually dialed in an emergency. 
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It makes no sense* hocjever, to say that the ITBS is "biased" sinply because it 
measures g&ieral knowledge and acadesnlc skills. This is exactly what the test 
is supposed to measure. Suppose a "Barrow Test of Basic Whaling Skills" were 
developed which measured general knowledge and skills inportant to the Inupiag 
culture. It would make no sense to say that the test of whaling skills is 
"culturally biased." The whaling test would be supposed to measure precisely 
these kinds of cultural skills. 

The question that rural parents and educators should ask is not "Is the IsOA 
Test of Baa.''; Skills culturally biased?" but rather "Is it inportant that rural 
children acquire genercd knowledge and academic skills?" Most Native parents 
want their children to have the knowledge and skills necessary to be effective 
as adults in both Native cultural contexts and in mainstream contexts. What 
the ITBS will tell parents is how their children stand in the area of general 
knowledge and academic skills coitpared to chidren across the country. 

What is ess<intifj. to keep in mind is that the ITBS measures only a limited 
number of academic skills. It is NOT a measure of intelligence, creativity, 
drive to achieve, concern ''or other people, or other important human 
characteristics. 
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Does the nss fairly measure what ve are teaching in our schools? 

Ohe TJSS was developed to measure a limited set of student achievements: basic 
skills in reading » language arts and mathematicst The tests' developers 
identified content and items for inclusion on the tests based on comnonly used 
texts and materials around the country at the time the tests were developed. 
ThuB, the IIBS can be useful as a general measure of basic skills attainment 
without necessarily being a good measure of the curriculum or program of a 
specific school* 

To the extent that the basic language artSf reading, and mathematics skills 
covered by the Iowa Teats of Basic Skills are taught in Alaska schools, the 
tests are fair measures of what we are teaching. However, the test 
does not cover all of the many skills taught in the schools across Alaska or 
any other state. 

Why do SGDe groups do better than others en measures like the UBS? 

It is ccinnon to find substantial differences in average scores of students when 
classified by ethnicity or gender. In the United States, many studies have 
shown that sti^ents with an Asian heritage do better than other groups of 
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students cn some tests while students from Black, Hispanic, or Native heritages 
do not do as well. In the early grades, girls do better than boys in language 
arts. 

Oie explanation for these group differences in test score is that cultural 
groups also differ in average income, level of education, and the value placed 
cn school achievement as opposed to other endeavors. Students who come frcm 
wealthier and more educated families often receive more special lessons and 
other educational opportunities and more help and encouragement with school 
w^>rk at home. Hiese are group differences and do not tell us. about individual 
students. Many minority students receive high scores on tests and do very well 
in school while many non-minority students do not do well in school and receive 
low test scores. 

A seccs^ explanation for group differences in test scores centers on the t^^s 
of schools minority students attend — particularly the academic eniphasis of 
the curriculum and the expectations of teachers. In a special analysis of the 
I1BS results for the Alaska Department of Education, H.D. Hoover, one of Uie 
authors of the ITBS, found that Native students in predominantly white schools 
performed m«x:h higher than Native students in predominantly Native schools. 
This result supports the idea that school differences may be inportant in 
explaining the lower performance of Native stud^ts on standardized tests. 
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Do test-makers sake any effort to eliminate test bias against minority groups 

Students who have the same level of conpetence in a subject like mathematics or 
language arts should get roughly similar scores on the ITSd, If minority 
students with the same level of conpetence as other students get lower scores* 
then the test is "biased" against them. 

Riverside Publishing Ccnpany, which publishes the ims, attempts to minimize 
such bias in a number of ways. Every test item undergoes three different 
expert reviews for possible bias. Including a review by a panel of independent 
experts selected on the basis of geographic region and ethnic cGoposition. 
Quantitative analyses of test results from an item tryout study are also done 
to see If minority students get lower test scores than non-minority students of 
similar abilities. 

•niese studiec, hwever, are primarily directed to^^ard fairness in the testing 
of African-American and Hispanic students. In an effort to detenrtine test and 
item bias with Alaska Native students, the Alaska Department of E3ucation 
contracted with H.D. Hoover for a special item bias study investigating 
differences in perforn.ance between Alaska Native students and white students in 
the Fall 1989 assessment results. 
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When Native students and white students of similar ability levels were 
conpared, Hoover found that 7 percent of the test items statistically favored 
white students and 6 percent of the items statistically favored Native 
students. In short# nearly the same number of test items were biased in favor 
of Native stud^snts as were biased in favor of White students. Thus, in a 
technical sense, the IIBS is not particularly biased against either Native or 
White students of similar levels of conpetence. 

Nfay dcn't W3 test sfudcnts In their own language rather than Bigllsh? 

Ihe Alaska statewide Assessment is intended to provide a single standard 
against which all Alaska a^hools may be tested. Since instruction in gra3e 
foui is for the most part in English, use of an Eliglish test shows how well 
studentD are doing in the language in which most schooling takes place. 

In sane Alaska schools, many students are bilingual and some come from homes 
where Jihglish is not spoken. This m^ make ccnpleting school work in Qiglish 
anci taking tests like the Iowa Testa of Basic Skill,? more difficult. As 
students become better at speaking Pnglish, however, both school performance on 
lessons in Ehglish and performance on tosts in Ehglish should inprove. Ov^r 
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the years, use of a test like the Iowa Tests of Basic Skills will show if this 
is the case in Alaska schools where niany students are bilingual. 

If one goal of the school is to provide a bilingual educational experience, the 
11SS does not measure these Native language skills. Other measures should be 
used to show student progress in coninunities where lessons are not taught in 
Qigllsh. 



What are the proper uses of standardized tests? 

Standardized tests have two main uses. First, individual student results 
provide teachers and parents with diagnostic information about learning 
pr< )leiTis, a measure of individual pupil progress, and assistance in identifying 
students with special educational needs. Second, group results enable 
measurement of class progress, documentation of curriculum and instructional 
effects, justification for funds to support special programs, measurement of 
school effectiveness, and the provision of accountability information to the 
public and legislators. 

It is the uses of test results, rather than the tests themselves, which most 
often lead to criticism that the tests are unjust or inappropriate. Generally, 
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the ccnpanles which produce standardized tests argue that the tests are but a 
single indicator o£ performance which should be used only in conjunction with 
other measures. If this recomnendation is followed » the test results beccme 
only one type of indicator which may be used by teachers or school 
administrators. Other indicators such as att&idancef graduation rates* grades* 
informal teacher assessmaits* teacher-made tests* school district criterion 
referenced tests* and the success of students after graduation may all be 
iirportant indicators of student and school success or failure. 

Is it beneficial to have Alaska Statewide Assesaoent scored 

Ihe state assessment program offers inportant benefits for school off icials» 
teachers* parents* and legislators, ^e IIBS provides an objective measure of 
how the performance of Alaska students and Alaska schools measures up against 
the performance of students and schools nationwide. Test resuJ.ts are like an 
orange warning light. If our students are not doing well conpared to others* 
we need to take a careful look at our curriculum and our schools. 

But the IIBS measures only some of our educational goals. Alaska communities* 
particularly rural Native comnunities* may want their schools to help maintain 
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tlie vitality of cultural traditions or teach locally important economic 
skills. The 11BS does not measure how well the schools respond to these 
camtunity goals. Nor does the IIBS measure intelligence, ccnpassion, or many 
other important human qualities. 

What the IIBS does measure is the extent to which Alaska students are conpetent 
in basic academic skills, such as reading, mathematics, and language arts. 
This is important knowledge, and it is the knowledge the tests give us. 
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